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Introduction 

The viability of any professional organization depends its members' 
continued satisfaction with its purposes, activities, and operations. Although 
it is possible to infer members' satisfaction with these organizational 
characteristics by reviewing their rates of continuaUon and defection, such 
summative data are of litde value in guiding organizational development or 
redirection. Information useful for formative evaluation (Scriven, 1967) 
must be secured by asking members directly, how satisfied they are with any 
and all characteristics of an organization that might be modified. 

To secure direct information concerning members* satisfaction with 
NCME as an organization, a survey of the NCME membership was developed 
and conducted under the auspices of the NCME Committee of Past 
Presidents. The survey was conducted by mail during the fall and winter of 
1989, and sought members' judgments concerning (1) the purposes of 
NCME as an organization, (2) NCME's major activities, (3) members' 
personal involvement in NCME activities, (4) the NCME Annual Meeting, (5) 
NCME's professional development activities, (6) NCME's publications, (7) 
members' interest in participating in the governance of NCME, (8) NCME's 
organizational structure, election, appointment procedures, and committee 
activities and (9) NCME's financial operations. 

This paper contains a review of the principal findings of the survey. A 
summary of the methods used in conducting the survey is provided first. 
Following a discussion of survey methodology, the report of survey findings 
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is organized around the topic areas listed above. A final secUon contains a 
discussion of the implications of survey findings. 

Methodology 

S ampling 

Data were collected through a mailed survey sent to 484 randomly- 
selected NOME members. A linear systematic sample of one in four of the 
1936 NCMS members who resided in the continental United States at the 
time of sample selection received a questionnaire. The sample was 
restricted to NOME members residing in the United States so as to 
minimize mailing expenses and to avoid inordinate delays in receiving 
survey responses. A sample size of 484 ensured that population proportions 
could be estimated within ± 0.05 with 95 percent confidence, allowing for a 
70 percent response rate. Selection of the sample was completed by a data 
processing specialist at NOME headquarters. 

Mailing and FolIow-up Procedures 

A packet containing a questionnaire (see Appendix A) a cover letter 
(see Appendix B) and a stamped, addressed return envelope were sent to all 
sampled NCME members on November 3rd. 1989. To minimize mailing 
costs, survey pacl<:ets were presorted by zip code and sent at the third-class 
postal rate. Return envelopes were also stamped and marked for third-class 
mailing. Mailing envelopes with the NCME letterhead were used to 
emphasize the "official" character of the mailing, even though packets were 
sent from the University of North Carolina at Greensboro (UNCG). For the 
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same reason, return envelopes were addressed to the NCME headquarters 
office in Washington, D. C. Completed questionnaires were sent by the 
NCME headquarters office to the Center for Educational Research and 
Evaluation at UNCG for data processing and analysis. 

NCME members who had not returned completed questionnaires by 
December 1, 1990 were sent a reminder postcard (see Appendix C), 
encouraging them to complete their questionnaires. The 209 members who 
had not returned completed questionnaires by December 20, 1990 were 
sent another full survey packet containing a modified cover letter (see 
Appendix D), a second questionnaire, and a second stamped return envelope 
addressed to the NCME headquarters office. 



Response Rate 

Three hundred seventy-seven of the 484 NCME members who were 
sent questionnaires responded to the survey. The overall rate of response 
was therefore 77.9 percent. However, 31 of the 377 respondents did not 
provide useable data. Analyses of survey data were therefore based on the 
responses of 346 sampled members, producing a useable response rate of 
71.5 percent. This response rate compares favorably with that of Coleman's 
1966 Survev on Equalitv of Educational Opportunity . The 31 respondents 
who did not provide useable data listed a variety of reasons for their decision 
not to participate in the survey. Among frequently-mentioned reasons were 
having dropped NCME membership prior to receipt of the survey 
questionnaire, and recency of NCME membership. The latter group felt 
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they had limited knowledge of NCME and were therefore unqualified to 
respond to the survey. 
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Representativeness of f^^rr^pU 

The NCME membership application contains three optional questions 
that can be used to develop a demographic profile of the organizaUon's 
membership. One question asks the applicant's gender, a second asks 
applicants to classify themselves into one of six race/ethnicity categories, 
and a third asks applicants to classify themselves into one of eight current 
employment categories. The responses of 2249 NCME applicants on file as 
of March 2. 1990 were used to construct distributions for comparison with 
those produced from responses to similar questions by the 346 members 
who provided useable survey data. These comparisons provide evidence on 
the degree to which survey respondents are representative of the entire 
NCME membership, at least on the gender, race/ethnicity, and current 
employment variables. 

The results shown in Figure A suggest that the gender distributions of 
survey respondents and NCME members are quite similar. However, the 
sample of respondents contained about ttiree percent more males, and 
three percent fewer females, than does the NCME membership. These 
dUferences arc minor, and would bias survey results only if the responses of 
female NCM.-. members differed markedly from those male members. 

The distributions shown in Figure B indicate that survey respondents 
overrepresented non-Hispanic Caucasians by about four percent. 

Ffl^cT — . 

o 



Figure A. Distributions of Respondents and NCME Membership, by Gender 
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Figure B. Distributions of Respondents and NCME Membership, by Ethnicity 
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underrepresented Hispanics by about one percent, underrepresented Black 
or Afro-American members by about two percent, and underrepresented 
Oriental or Asian members by about one percent. Again, these distributional 
dsfferences are small, and are unlikely to produce appreciable biases since 
minority representation among the NCME membership is unfortunately 
small. 

NCME members who are employed in school systems or testing 
organizations were slightly overrepresented in the sample of respondents, 
and members employed in colleges or universities were slightly 
underrepresented (see Figure C). Since one percent of the sample is 
composed of four members, and the largest within-category difference 
between tJie sample and the entire membership was about four percent, the 
sample is unlikely to be seriously unrepresentative. This question could be 
illuminated by completing separate analyses of tlie responses of members 
employed in colleges or universities and members employed in school 
systems. 

In summjiry, it appears that the san:»ple of respondents is reasonably 
representative of the entire NCME membership in its gender composition, 
its racial and e thnic composition, £ ' its distribution by type of employment 
organization. 

Estimation Pre^ !ision 

As noted (jarlier, the sample size of 484 members was designed to 
ensure estimation of population proportions within ± 0.05 with 95 percent 
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Figure C. Distributions of Respondents and NOME Membership, by Current Employment 
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confidence, provide the survey response rate was at least 70 percent. This 
desired estimation precision was realized with the final sample size of 346 
useable responses. Evaluation of EquaUons (3.23), p. 58 of Jaeger (1984) 
with an estimated proportion of 0.5 produces a 95 percent confidence 
interval on a population proportion ranging from 0.45002 to 0.54998. 
Estimated proportions that differ from 0.5 will result in narrower 
confidence intervals. 



Data Reduction and Analysis 

Numerical data were entered into a Reflex data base management file 
on a Macintosh microcomputer and were transmitted electronically to a VAX 
7800 mainframe computer. Prior to analysis, data entered from several 
quesUonnaires were visually verified for data-entiy accuracy, and all data 
were visually scanned for accuracy of field location and magnitude. 
Frequency distributions for each variable were checked for out-of-range data 
entries. All questionable entries were verified against original 
questionnaires and were corrected if necessary, prior to final data analysis. 
The SPSS'^ statistical package was used to analyze data and various graphical 
presentation programs for the Macintosh, including Statview 512 and 
Cricket Graph, were used to produce graphical displays. 
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As noted earlier, the survey of NCME members included a wide range 
of topics ranging from the purposes of the organization to its financial 
operations. The results of the survey are summarized below in ten 
subsections entitled (1) Purposes of NCME, (2) AcUvities of NCME, (3J 
Personal Involvement of NCME Members, (4) The NCME Annual Meeting, 
(5) NCME's Professional Development ActiviUes, (6) NCME's Publications, 
(7) The Governance of NCME, (8) NCME's Membership Recruitment 
Activities, (9) NCME's Financial Operations, and (10) the Demographics of 
NCME's Membership. 

Purposes of NCME 

The first section of the survey questionnaire focused on the underlying 
purposes of NCME. Survey respondents were asked to consider the 
appropriateness of various organizational purposes, the importance of those 
purposes, and the success of NCME in achieving those purposes. In 
response to each of 14 stated purposes of NCME, respondents were asked 
to indicate whether the stated purpose was "inappropriate" or "appropriate," 
to rate the importance of the purpose on a stx-point scale ranging from "not 
at all important" to "very important," and to rate how successfully NCME had 
achieved the purposes on a six-point scale ranging from "not successful" to 
"very successful." Ten of the fourteen stated purposes were derived directly 
from the NCME bylaws. Four additional purposes were developed to reflect 
recent NCME activities or purposes that had been considered by the NCME 
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Board in recent years. These latter purposes included "NCME should 
promote standards for teacher preparation in the field of educational 
measurement." "NCME should promote standards for the accreditation and 
certification of professionals in educational measurement," "NCME should 
promote adherence to the Standards for Educational and Psychological 
Testing by assuming appropriate public policy positions," and "NCME should 
promote adherence to standards of professional conduct among those in the 
field of educational testing and measurement." 

Appropriatfinftss 

As shown in Figure 1, twelve of the fourteen stated purposes were 
endorsed as appropriate for NCME by at least 94 percent of survey 
respondents. The two stated purposes endorsed by smaller percentages of 
respondents were among those not derived from the organization's bylaws: 
"NCME should promote standards for teacher preparation in the field of 
educational measurement" was endorsed as appropriate by 87 percent of 
respondents, and "NCME should promote standards for the accreditation 
and certification of professionals in educational measurement" was endorsed 
as appropriate by 74 percent of respondents. In summary, survey 
respondents overwhelmingly verified the appropriateness of all 
organizational purposes derived from NCME's bylaws, endorsed two 
potential purposes with equal enthusiasm, and endorsed two more potential 
purposes by a substantial majority. 
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Fig. 1 Percent Endorsing Various Purposes as Appropriate for NCIVIE 
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Respondents rated the Importance of each of 14 purposes of NOME on 
a scale that ranged from zero (Not at All Important) to five (Veiy Important). 
Although the end points of this scale were verbally anchored, intermediate 
points were not. If we infer a verbal anchor of "Moderately Important" for 
the midpoint of the scale (2.5), we can conclude that the average raUngs 
survey respondents assigned to these 14 purposes ranged from just above 
"Moderately Important" to Just below 'Very Important." It is not surprising 
I that the purpose endorsed as appropriate by the smaUest percentage of 

respondents. "NOME should promote standards for the accreditation and 
certlficaUon of professionals in educational measurement." received the 
lowest mean importance rating (2.94). Every other purpose of NOME 
received a mean importance rating of at least 3.5 on the zero4o~five scale. 
The mean importance ratings summarized in Figure 2 aie grouped; 
* purposes with mean importance ratings in the same half-scale-value inten^al 

(e.g., 5.00 to 4.50, 4.49 to 4.00, etc.) are grouped together. With the 
exception of the "promote standards for accreditation and certification..." 
purpose, survey respondents considered proposed purposes of NOME to be 
at least one scale-point above the "Moderately Important" midpoint. 
Promoting the improvement of measurement procedures and instruments 
and promoting the development of measurement theory, and disseminating 
the results of these improvements and developments, were judged by 
respondents to be most important. The only other proposed purpose that 
received a mean rating above 4.0 was "promoting adherence to the 
Scandards ... ." Purposes that Involved applications of measurement to 
Individual assessment and program evaluation, disseminaUon of applicatlonal 
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Fig. 2 Mean Importance Attributed to Various NOME Purposes 
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knowledge, and promotion of professional standards and standards for 
measurement preparation of teachers received somewhat lower mean 
ratings, in the range 3.50 to 3.99. 

Success 

Respondents also rated the success of NCME in achieving each of 14 
purposes on a scale that ranged from zero (Not at All Successful) to five 

ijl (Very Successful). Again, although the end points of this scale were verbally 

anchored, intermediate points were not. If we infer a verbal anchor of 
"Moderately Successful" for the midpoint of the scale (2.5), we can conclude 
that the average ratings survey respondents assigned these 14 purposes 
ranged from just above "Barely Successful" (1.68) to just below "Quite 
Successful" (3.62). Comparison of the rank order of purposes rated on the 

* importance scale in Figrire 2 and the success scale in Figure 3 reveals 

substantial consistency. In general, respondents judged NCME to be most 
successful in achieving objectives that were judged most important. 

Respondents judged NCME's success in achieving particular purposes 
to average about one point lower on the six-point scale than their 
corresponding mean ratings of the importance of those purposes. It is not 
unexpected that average judgments of NCME's success in achieving 
purposes derived from its bylaws were higher than average judgments of 
NCME's success in achieving the four purposes that were derived from 
recent Council activities or minutes of NCME Board meetings. 
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Fig. 3. Mean Success Attributed to Achievement of Various NCME Purposes 
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NCME was Judged to be most successful in promoting the 
development and disseminaUon of measurement theory (perhaps through 
the sJQpm^l of Rdnrf^flonRl Measurement). NCME was judged to be slighUy 
less successful in achieving purposes linked to improvement and 
disseminaUon of measurement procedures and dissemination of 
improvements in educaOonal measurement instruments. NCME was Judged 
to be decidedly less successful in achieving purposes related to applications 
of educational measurement to Individual assessment or program evaluation; 
Judgments of NCME's success in achieving these purposes hovered just 
under three on a six-point scale with a maximum value of five. Thus NCME's 
success in achieving these purposes was Judged to be slightly higher than 
"Moderately Successful." 

As noted earlier. NCME was Judged to be least successful In achieving 
the four purposes that were not derived from its bylaws. Although NCME 
was judged to be moderately successful in promoting adherence to the 
Standards for Educational and Psychological Testing . the organization was 
judged to be decidedly less successful in (1) promoting adherence to 
professional standards among measurement specialists, (2) promoting 
standards for the preparation of teachers, and (3) promoting standards for 
accreditation and certification of professionals in the measurement field. 
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Summary 

Respondents' ratings of the 14 current and proposed purposes of 
NCME suggest that the NOME membership Judged these puiposes to be 
appropriate, and "moderately important" to "very important" to the 
organization. On a six-point scale of importance where 5 was the maximum 
score, mean importance. raUngs ranged from 2.94 to 4.71. However, NCME 
was judged by respondents to be markedly less successful in promoting the 
achievement of these purposes (with means on the same scale ranging from 
1.68 to 3.62). Perhaps the message for the NCME Board of Directors is to 
resist modificaUon of the organization's purposes, and concentrate instead 
on building more-effective strategies for achieving the core purposes of the 
organization that were derived from its bylaws. 



NCME's AntivltieR 

Survey respondents were asked to consider 23 current and proposed 
acUvities of NCME. Respondents stated whether NCME should or should 
not continue to engage in each acUvity, and judged the importance of each 
activity "for NCME as an organization" by raUng it on a six-point scale that 
ranged from "Not at All Important" (0) to 'Very Important" (5). For 
purposes of analysis, the 23 acUvlties were classified as "Internal;" i.e., 
principally designed to serve the NCME membership, and "External^ i. e., 
principally designed to serve the larger measurement communit3^ the field 
of education, or the public. This classification is admittedly arbitrary and 
arguable. For example, NCME's publications were placed in the "Internal" 
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category although many would argue that their readership extends well 
beyond the NCME membership. Nonetheless, the t^vo-rategory 
classificaUon provided a convenient way of organizing the 23 activities. 

Continuatjnn of Internal Activities 

As shown in Figure 4. internal activiUes of NCME were divided into 
those related to the Annual Meeting, those related to NCME's publicaUons, 
I and those related to recruitment. Nearly all respondents endorsed the 

continuation of annual meeUngs and the presessions and workshops held at 
the annual meeUngs. Likewise, continued publication of NCME's two 
Journals was endorsed by 99 percent of the respondents. 

Continued publication of the Instructional Tonics in Educational 
^ ^ifiasuremfint modules was endorsed by 95 percent of respondents, while 

continuation of special publications received a respectable 91 percent 
endorsement. Surprisingly, continued publication of the Resource Bank , 
one of NCME's best-kept secrets, was endorsed by more than four in five 
respondents. Only half the respondents felt that NCME should add 
publications or increase the size of its existing publicauons. 

Continuation of recruitment activiUes, including recruitment of 
minorities to the field of educaUonal measurement or to NCME, and 
assisting colleges and universities in recruiting students to the field of 
educational measurement, were endorsed by three-fourths to four-fifths of 
responding members. 
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Fig 4. Percent Endorsing Continuation of Various Internal NCME Activities 
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Importance of Internal Artivitips 

Mean importance ratings assigned to internal NCME acUvities are 
shown in Figure 5. Comparison of the percentages of respondents 
endorsing continuation of vailous internal activities (Figure 4) and mean 
importance ratings assigned these acOvities (Figure 5) suggests that the 
results shown in Figure 5 provide little additional information. Were mean 
importance ratings to be shown as percents of maximum scale value, they 
would be almost identical to the endorsement percentages shown in Figure 
4. NCME's annual meetings and journals were judged to be very important, 
workshops and other publication activities were Judged to be well above 
"moderately Important," recruitment activities were judged to be more than 
"moderately important," and increasing publication volume was judged to be 
relatively least important. 

In summary, respondents uniformly endorsed continuation of NCME's 
annual meeting and publication activities, were mixed in their endorsement 
of increases in NCME's publication volume, and rated recruitiment activities 
a distant second behind annual meeting and publication activities. As noted 
above, judged publication of JEM, holding annual meetings, and pu jlication 
of EM:IP to be most important. Training activities and other NCME 
publication activities were judged to be of somewhat lesser importance, and 
recruitinent of students and minorities to the field of educational 
measurement were judged to be relatively least imr -tant. However, all 
mean importance ratings assigned to these activities were higher than the 
"moderately important" midpoint of the importance scale. 
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Fig. 5 Me&n Importance Attributed to Various NCIVIE Activities 
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Continuation of Ry^ff mal Activities 

External activities were classified into four subcategories: those 
concerned with professional standards and certlficaUon, those concerned 
with professional development and training, those concerned with 
measurement leglslaUon, and those concerned with cooperative engagement 
with other organizations. ActlviUes in the first subcategory received 
continuation endorsements ranging from 74 percent to 93 percent. 
Working with other organizations to develop procedures for accreditation 
and certification of measurement professionals was endorsed by only 74 
percent of respondents, monitoring adherence to the Code of Fair Tc^stlng 
Praptiggg was endorsed by 83 percent of respondents, and working with 
other organizations to develop curriculum standards for the measurement 
preparation of teachers was endorsed by 88 percent of respondents. Most 
popular (with endorsement by 83 percent of respondents) was working with 
other organizations to set standards of professional conduct in 
measurement. This activity would constitute a new endeavor for NCME; it 
fshould receive serious consideration by the Board. 



Activities related to professional development and training of teachers 
in educational measurement were also popular. Working with other 
organizations to identify educational measurement skills and information 
needed by education professionals was endorsed by 95 percent of 
respondents, and sponsoring measurement training programs for teachers 
was endorsed by 83 percent of respondents. Both of these acUvities would 
constitute new endeavors by NCME. Although their cost implications are 
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Significant, they should be considered by the Board. Appropriately 
developed, they might prove to be sources of additional revenue for NCME. 

Four proposed activities concerned working with or informing 
legislatures on measurement-related issues. Keeping the membership 
informed about pertinent legislation and disseminating information to 
legislators were almost universally endorsed by respondents. Working with 
legislatures was a bit less popular (91 percent endorsement), and 
respondents were a bit more wary about NCME's working with other 
organizations to take advocacy positions on legislation or public policy issues 
pertinent to educational measurement (endorsed by 86 percent). 
Respondents clearly expressed the view that NCME should not be an Insular 
organization on issues dealing with new measurement legislation. Endorsed 
with equal enthusiasm were activities Involving work with other 
organizations composed of professionals in educational measurement (99 
percent) and professionals outside the field of educational measurement (93 
percent). 

Importance of External Activities 

The mean importance ratings assigned to "external" NCME activiUes 
parallel the percentages of respondents endorsing continuation of these 
activities to the extent that additional discussion would be totally redundant 
(compare Figures 6 and 7). 
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Fig. 6 Percent Endorsing Continuation of Various External NCR/IE Activities 
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Fig. 7 Mean Importance Attributed to Various External NCME Activities 

1^ 

MAXIMUM POSSIBLE MEAN HH^HHHH^HB^^^I 

Standards Profess. Conduct ^^^^^■^^^^^^HHMHiMg 3.77 

Monitor Adherence to Code ^^^^^^^^^^^^^^^^^HH 

Standards for Teacher Prep. ^^^^^^^^■^■■MHM 3.37 

Certification Measurement Prof. ^^^^^^^^^HHHI 



Identify Needed Profess. Sidlls ^^^^^^^^^^^^^^ttKBt ^'^^ 
Training Prog, for Teachers W^^^^^^^^^mmmmmmm 3.45 



Monitor Testing Legislation i^^^^^^^^^^^^^^^^^^HB ^'^^ 
Disseminate Info Legislators ^^^^^^^^^^m^mamm^^ 4.O1 

Legislation ^^^^^^^^^^^^^^^^KKKt ^'^^ 

Take Advocacy on Legislation ^^^^^^^^^^^^^^^^H ^'^ 



Other Organlz. ^^^^^^^^^^^^^^HHH ^'^^ 

Organizations ^^^^HHHHHH^^ 3.37 

0 1 2 3 4 5 

Not at All 

Very 



ERIC 



30 



Summary 



None of NCME's current activities was endorsed by so few 
respondents that the Board should seriously consider its discontinuaUon. 
However, three potential activities were endorsed by such large percentages 
of respondents that the Board should, within obvious budget constraints, 
consider their initiation. These three are: (1) Working with other 
organizations to set standai'ds of professional conduct in measurement, (2) 
working with other organizations to identify educational measurement skiUs 
and information needed by education professionals, and (3) sponsoring 
measurement training programs for teachers. In the long term, the last two 
activities might be developed as sources of additional revenue for NCME. 



The NCME Annual Meeting 

The survey contained questions that addressed respondents' 
participation in NCME's annual meeting and their perceptions of certain 
features of the annual meeting. These latter questions sought members' 
evaluations of these features. Responses to questions concerning NCME 
members' attendance at annual meetings; participation as a paper or 
symposium presenter; participation as a session chair, discussant, or 
reactor; and attendance at training sessions are summarized in Figures 8 
and 6.1. 

Perhaps most interesting are the findings that more than a fourth of 
the membership has not attended an NCME annual meeting in the last five 
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Fig. 8 Participation In the Five Most Recent NOME Annual Meetings 
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Fig. 8.1 Distribution of Attendance (Five Most Recent Annual Meetings) 
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years, and that well over half the membership has attended fewer than half 
the annual meetings held during the last five years. Although most NCME 
members consider the annual meeting to be among the organization's most 
important activities, many are either unable or choose not to participate in 
these meetings. 

Also revealing are the findings that more tlian two-thirds of the 
respondents have not presented a paper at NCME annual meetings held 
during the last five years, and that fewer than 12 percent of respondents 
have presented papers at a majority of the annual meetings held during the 
last five years. Even fewer members participate in the annual meetings as 
session chairs, discussants, or reactors. Participp*' jn in training sessions 
was likewise reported by relatively few members (only 18 percent attended 
a training session at one annual meeting during the last five years, and only 
four percent attended a training session at two annual meetings dming the 
last five years). 

These findings suggest that active participation in NCME's annual 
meetings is restricted to relatively few members. If the Board j'^dged it to 
be worthwhile, the Annual Meeting Program Committee could very likely 
broaden the memberships' participation as session chairs or discussants. 

Table 1 contains a summary of respondents' mean evaluative ratings of 
various features of the NCME annual meetings, ranging from their 
organization to their timing. The highest marks were earned by the 
organization of the annual meeting (with a mean of 4.2 on a five-point scale) 
and convenience of meeting locations (with a mean of 4.1). Questions 
concerned with expense, meeting length, relevance of content, and 
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Table 1. Members* Perceptions of Features of the NCME Annual Meeting 

(Mean Response by Subscale) 
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convenience of timing resulted In mean ratings that were consistently above 
the neutral point, but not overwhelmingly positive. 

Respondents' perceptions of various features of NCME's professional 
development activities are summarized in Table 2. A majority of 
respondents had no opinion concerning NCME's professional development 
activities, a finding that is not surprising since so few members participate 
in these activities. The organizaUon of NCME's professional development 
activities was awarded the highest mean rating assigned by those expressing 
an opinion (3.8 on a five-point scale). Other features of NCME's professional 
development activities, including scheduling, expense, length, and content 
relevance, were assigned mean ratings that were barely above the neutral 
point. 



In summary, relatively few NCME members are active participants in 
the organization's annual meetings, and more than a fourth are either unable 
to attend or choose not to attend at all. Those attending annual meetings 
gave high marks to the organization of the meetings and the convenience of 
the locations where they are held. Other aspects of the annual meetings 
were Judged, on average, to be more positive than negative. Those 
expressing an opinion about NCME's professional development activiUes also 
judged them to be more positive than negative, but average Judgments of 
their scheduling, expense, length, and content relevance were only 
marginally above the neutral point. 
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Table 2. Members' Perceptions of Features of NCME's Professional 

Development Activities 

(Mean Response by Subscale) 
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The Journal of Edu cational Measurement 

Respondents were presented with qucsUons concerning their use of 
and contribution to the Journal of Educational MeaQiirr>m..n| ygM), and 
with questions concerning their satfsfactlon with various characteristics of 
the ilQumal of E^ucatJonal Measurement. Summaries of responses to the 
first set of questions are shown m the two distributions in Figure 9. 

jIEM enjoys a local and active readership. Over 30 percent of survey 
respondents reported that they read every issue of JIM. and 42 percent 
more reported that they read OEM "regularly." Only six percent of 
respondents reported that they read JEM "seldom" or "never." The high 
utUlty of OEM to the readership's work is reflected m the report of 32 
percent of the respondents that they "use sIEM m their work regularly." An 
additional 50 percent reported that they use JEM in their work 
"occasionally." 

As might be expected, far more NCME members read JEM regularly 
than use it as a vehicle for publication of their measurement research 
findings. Over three-fourths of the respondents reported never having 
published a paper in ^JEM. and another 15 percent reported having had one 
or two papers published in the twenty-five -year history of the Journal. 

On a six-point scale ranging from "Not at All Satisfied" (0) to "Veiy 
Satisfied" (5). respondents assigned a mean rating of 3.94 to the quality of 
the research described 'i ^JEM. and nearly identical ratings of 3.74 and 
3.73, respecUvely, to timeliness of ar0cl.es and the quality of writing in JEM 
(see Figure 10). If we assign the definition "Moderately Satisfied" to the 



ERJ.C 



Page 37 

38 



Fig. 9 Distribution of Frequency of Members' Reading, Use of, and Contribution to JEM 
Every Issue 

30.1 
31.6 



49.9 






•T ^ 






0S 


Regularly 


////////// 







c 

3 Occasionally 

2 i 
u. 

Seldom 



Never 



' ' // ■■ /// 



14 




^2.3 
0.6 



— T" 

1 0 



■ Read JEM 

0 Use JEM In Work 



' I 

2 r 30 

Percent 



— r- 
40 



— I 
5 0 



Ml 



x: 
a 



o 

a. 

C9 



JQ 

E 

3 
Z 




77.8 



ERIC 



Figure 10. Members' Mean Satisfaction With Selected Characteristics of JEM 
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midpoint of the six-point scale (2.5), we might conclude that, on average, 
respondents are "quite satisfied" with these characteristics of JEM . 
Although 28 percent of respondents had no opinion about JEM 's editorial 
poUcies. those who expressed an opinion assigned a mean rating of 3.6. well 
above the "Moderately Satisfied" midpoint of the scale. Respondents' mean 
satisfaction with the scope of content presented in JEM was somewhat 
closer to the scale's midpoint (3.11), a finding that might warrant a more 
detailed follow-up study. 

!ft Educational Measuremftnt: Tasii es and Frantic^ 

As was true of questions concerning the Jo.imal of Educational 
Mgagyrgmgnt . respondents were presented with questions concerning their 
use of and contribution to Educational Measurement: Issues and Practice 
(EMlIP) and with questions concerning their satisfaction with various 
I characteristics of Educational Measurement: Issues and Pra ntire 

Summaries of responses to the first set of questions are shown in the two 
distributions in Figure 1 1 . 

Like OEM, EM:IP is widely read by the NCME membership. More than 
31 percent of respondents reported reading every issue, and another 32 
percent reported reading EM:IP "regularly." However, 13 percent of 
respondents reported that they "seldom" or "never" read EMiIP . a value that 
is twice as large as the corresponding percentage for JEM . The utility of 
EMlIE to the work of survey respondents was also somewhat lower than that 
of JEM. About a fourth of the respondents reported using EM:IP "regularly" 
in their work, and 43 percent reported that they use it "occasionally." 



ERIC 



Page 40 

41 



Figure 11. Distribution of Frequency of Members' Reading, Use of, and Contribution to EM:IP 
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However, over 30 percent reported that they "seldom" or "never" use EM;IP 
in their work. 

Since EMjIE is a far younger Journal than JEM , it is not surprising that 
a larger percentage of the NCME membership (almost 90 percent) has 
never published in EM;IP . Another seven percent has had one or two papers 
published in EM:IP . 

Somewhat higher percentages of respondents had no opinion about 
various characteristics of EMlIE than was true of the same characteristics of 
JIM (compare Figures 10 and 12). However, those who expressed an 
opinion assigned higher mean satisfaction ratings to the characteristics of 
EMUE than they assigned to corresponding characteristics of JEM . On a six- 
point scale with 5 representing 'Very Satisfied" and 0 representing "Not at 
All Satisfied," respondents' mean ratings ranged between 3.51 (for relevance 
of content) to 3.95 (for timeliness of articles). Clearly, those who read 
EMilP are quite well pleased witii its content, timeliness, use as a vehicle for 
disseminating information about NCME, quality of writing, and editorial 
policies. Characteristics on which respondents were, on average, slightly 
less satisfied, included the scope and relevance of the content of EM:IP. 
However, as has been noted, EM:IP received marks that were substantially 
above the "Moderately Satisfied" midpoint of the satisfaction scale on tiiese 
characteristics as well. 
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FIG. 12 Members' Mean Satisfaction With Selected Characteristics of EM:IP 
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In summary, NCME members appear to be well satisfied with the 
quality of the organization's two principal publications - the Journal of 
Educational Measiirf»m^nt and Educational Measurement: Issues and 



Practice. Both Journals are widely and regularly read, both are relevani: to 



the work of substantial portions of the NCME membership, and both 
received mean satisfaction ratings on most characteristics that were well 
above the "Moderately Satisfied" level. Although these results suggest that 
the scope of content of JEM might be examined through a more intensive 
study of the desires of the JEM readership, its mean rating was above the 
"Moderately Satisfied" level. 



Instructi onal Topics in Educational Measurement 

Five questions sought infoni.c4^un on respondents' use of and 
satisfaction with various characteristics of the Instructional Topics in 
Educational Measurement (ITEMS) modules that have appeared in a number 
of issues of Educationa l Measurement; Issues an d Practice . Responses to 
these questions are summarized in two distributions, shown in Figure 13. 
Although a majority of survey respondents reported that they have never 
used the ITEMS modules, more than a fourth reported that they have used 
the modules "occasionally." When rates of even- more -frequent use area 
added to that of "occasional" use, more than a third of the survey 
respondents use the ITEMS modules at least "occasionally." 
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Fig. 13 Members' n/lean Satisfaction With, and Frequency of Use of ITEMS 
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Slightly more than half the survey respondents had no opinion about 
various characteristics of the IHMS modules (presumably those with no 
opinion are the non-users). TTiose who expressed an opinion on the six- 
point satisfaction scale ranging from "Not at All Satisfied" (0) to 'Very 
Satisfied" (5). assigned mean ratings between 3.7 and 3.8. Just below die 
"Quite Satisfied" level, to dissemination of the ITEMS modules tiirough 
EMilE. the timeliness of topics ti-eated in tiie ITEMS modules, and the 
appropriateness of tiie level of discourse used in the ITEMS modules. The 
relevance of topics treated in the ITEMS modules received a somewhat 
lower mean satisfaction rating of 3.4, still well above tiie midpoint of Uie 
satisfaction scale. 

The Resource Bank 

As noted earlier, tiie Resource Bank might be NCME's best kept 
secret. When asked about tiieir satisfaction wltii its characteristics, about 85 
percent of survey respondents had no opinion, and nearly 80 percent of 
respondents responded "Never" to a question on tiie frequency of tiieir use 
of tiie EeSimimBank. it is likely that most NCME members have never 
heard about tiie availability of tiie R esource Bank, since tiie mean satisfaction 
rating assigned "Effectiveness of advertisements announcing tiie Resource 
Sank" was 1.58 on tiie six-point satisfaction scale. The relatively few 
respondents who were familiar witii the Resource Bank assigned in mean 
ratings Just above tiie "Moderately Satisfied" midpoint of the satisfaction 
scale on such characteristics as quality of selections (3.2), timeliness of 
sources (3.0). and relevance of topics (2.9). These results are summarized 
in Figure 14. 
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Fig, 14 Members' Mean Satisfaction With, and Frequency of Use of Resource Bank 



o 
c 
a 

or 
o 

UL 



Regularly 



Occasionally 



Seldom 



Never 




79.8 



c 
ra 
00 

0) 

o 

3 
O 

w 

0) 
K 



w 
o 

w 

0) 

o 

(Q 



(Q 



MAXIMUM POSSIBLE MEAN 



Quality of Selections 



Timeliness of Resources 



Relevance of Topics 



Effectiveness of Advertisment 




Percent No 
Opinion 



86.1 



85.8 



84.7 



74.3 



Not at All Satisfied 



4 5 
Very Satisfied 



ERJ.C 



4« 



In summaiy. the ITgM$. modules appear to serve a sizeable minority of 
the NOME membership, and that minority appears to be reasonably well 
saUsfied with their content, timeliness, and dissemination. In contrast, the 
Rg$Qurcg Bank Is used by very few NOME members, presumably because it 
has not been adverUsed effectively. Another factor that might explain the 
difference between use of the Resource Rank and the ITEMS modules Is the 
no-cost distribution of the ITEMS modules through EM:IP and the small 
charge for c btaining copies of the Resource Bank . Those who have used the 
RggQurcfi B^nk appear to be moderately satisfied with its quality, timeliness, 
and relevance. 



NCME Members' Inter est in Or( ?a nl2ational Participatio n 

The principal resource of any professional organlzaUon Is the 
willingness of its members to sustain the activities of the organization by 
participating in its governance structure and serving on its working 
committees. To determine NCME members' willingness to serve the 
organization, survey respondents were asked to consider three types of 
NCME service: membership on NCME committees, membership on NCME's 
Board of Directors, and becoming an NCME officer. 

The results summarized in Figure 15 suggest that NCME enjoys a 
membership that is rich in potential committee members. Board members, 
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Fig. 15 Members' Interest In Serving NOME In Various Capacities 
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and officers. More than one in five respondents indicated that they were 
'Very Interested" in serving as a member of an NCME committee, and an 
additional two In five indicated that they were "Fairly Interested." Almost 13 
percent of respondents were 'Very Interested" in serving on the NCME 
Board of Directors, and an additional 32 percent were "Fairly Interested." At 
least a third of the respondents were either 'Very Interested" (9 percent) or 
"Fairly Interested" (25 percent) in becoming an NCME officer (Vice 
President and then President). 



In summary, many members are interested in serving NCME through 
its committees, as Board members, and as officers. Perhaps the Board can 
develop strategies for broadening members' opportunities to serve NCME by 
seeking nominations (including self-nominations) for committee chairs and 
members, and by suggesting (or mandating) that the Nominations 
Committee routinely seek suggestions from the membership (perhaps 
through announcements published in EMrIP) prior to finalizing its 
recommended slate. 



NCME's Governance Procednres 

A number of survey questions sought infonnation on respondents' 
satisfaction with NCME's governance structure, including the procedures 
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used to elect officers and Board members and to appoint committee 
members. Respondents were also aslted to report their satisfaction with the 
cooperative management agreement under which the American Educational 
Research Association provides central office services for NCME. and to rate 
the quality of functioning of each of NCME's ad-hoc, joint, and standing 
commiittees. 

Respondents' satisfaction with NCME's election and committee 
appointment procedures is summarized in Figure 16. Results Indicate that a 
majority of respondents are 'Very Satisfied" with procedures used to elect 
NCME's Board members and officers, and that another third are "Fairly 
Satisfied." However, slightiy more than a third of respondents aie "Very 
Satisfied" and about 40 percent are "Fairly Satisfied" with procedures used 
to appoint chalis and members of NCME's ad hoc and standing committees. 
No more than five percent of respondents stated that they are "Not at All 
Satisfied" with NCME's election or appointment procedures. 

The cooperative management agreement under which the Amei-*can 
Educational Research Association provides central office services for K JME 
is highly regarded by NCME members. More than 55 percent of 
respondents stated that they were 'Very Satisfied" with this arrangement, 
and anotiier 27 percent were fairly satisfied, '^t is probably safe to conclude 
that most of those who marked "Uncertain" did so because they did not 
know the terms of the cooperative management agreement; an "Uncertain" 
response should not be interpreted as indicating disapproval. These results 
are shown In Figure 16.1. 
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Fig. 16 Members' Satisfaction with NCME's Election/Appointment Procedures 
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Fig. 16.1 Members' Satisfaction with tiie AERA Cooperative IWanagement Agreement 
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Figures 17, 18, and 19 summarize respopHf^nts' ratings of NCME's ad 
hoc. Joint, and standing committees, respectively. Respondents were asked 
to rate the functioning of each committee on a four-point scale ranging from 
"Poor" (0) to "Excellent" (3). Tliey were also permitted to Indicate that they 
had Insufficient information to render a Judgment by marking "Don't Know." 

Between 75 percent and 86 percent of respondents indicated that 
they had Insufficient information to rate the quality of NCME's ad hoc 
committees (see Figure 17). These statistics suggest that the Board might 
take actions to better inform the membership about NCME's committees 
and their activities. Respondents who evaluated NCME's ad hoc committees 
generally gave them average ratings in the upper portion of the "Fair" to 
"Good" range. Exceptions were the Committee on Past Presidents (the 
mean rating of this committee was 2.04 -- a value Just above "Good" and the 
Committee on Participation of MlnoriUes in Education (the mean rating of 
this committee was 1.22 a value that is marginally above "Fair"). 

Together with several other professional organizations, NCME 
contributes to the activities of two Joint committees: The Committee on 
Stardards for Program Evaluation and the Committee on Testing Practices. 
The functioning of both of these committees was well regarded by survey 
respondents who rated them (mean ratings of both committees were above 
"Good"). However, over 60 percent of respondents had insufficient 
information to rate the Committee on Standards for Program Evaluation and 
a majority had insufficient information to rate tlie Committee on Testing 
Practices (see Figure 18). In general, NCME's standing commlttee3 v -re 
Judged more favorably than were its ad hoc committees. Mean ratings of 
these committees ranged from Just below "Good" (for the Membership 
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Fig. 17 Members' Mean Ratings of NOME Ad Hoc Committees 
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Fig. 18 Members' Mean Ratings of NOME Joint Committees 
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Fig. 19 Members* Mean Ratings of NOME Standing Committees 
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Committee) to Just above "Good" (for tlie Committee on NCME's Career 
Award for Contributions to EducaUonal Measurement). Although a higher 
percentage of respondents provided ratings of NCME's standing committees 
than of its ad hoc committees, between half and tliree-fourths of 
respondents had insufficient Information to judge the functioning of these 
committees (see Figure 19). 



In summary. NCME members appear to be generally satisfied with the 
organization's election and committee appointment procedures, and with 
the cooperative management agreement under which AERA provides 
central office operations for NCME. Most NCME members are insufficiently 
Informed about the organization's ad hoc. Joint, and standing committees to 
rate their functioning. Members who rated NCME's ad hoc committees 
generaUy gave them average grades ranging from "C+" to "B." NCME's Joint 
and standing committees faired a bit better, receiving average grades in the 
'B-" to "B+" range. These findings do not indicate the need for radical 
revision of NCME's election and appointment procedures, although results 
summarized in the previous section suggest that a broader cross-section of 
the membership should be provided with opportunlOes to serve as Board 
members and officers. However, it is noteworthy that most survey 
respondents are unlnfonned about the functioning of NCME's committees. 

Opportunities to learn about these committees could be provided through 
descriptive articles in PM:IP or Uirough open meetings of committees 
during the NCME aimual meeting. 
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Expanding NCME's M embership 

Ninety-two percent of survey respondents agreed with the statement 
"NCME should try to expand its membership" (see Figure 20). Strategies for 
attracting new members that were at least as widely supported included 
providing a booth at the AERA/NCME annual meeting, sending contact 
letters to members of related organizations, and seeking members of related 
organizations through other (unspecified) means. Atti-actlng members of 
racial minority groups to NCME was endorsed by 85 percent of respondents, 
and attracting more female members was endorsed by 80 percent. Almost 
half the respondents felt that NCME should talce additional measures to 
attract new members. In the eyes of the membership, the goals of the 
NCME Membership Committee will not soon disappear. 

NCME's Financial Operations 

Two sections of the survey questionnaire posed questions concerning 
NCME's income distribution and expenditure distribution. In the income- 
distribution section, respondents were shown a pie chart indicating that 38 
percent of NCME's current revenues are generated through members' dues 
payments. 23 percent are generated tJirough subscriptions to JEM . 19 
percent are generated through the annual meeting, six percent are 
generated through sub&cilpHons to EMiIP . and 19 percent Lre generated 
through other sources. Respondents were asked to recommend either 
decreasing, malntai-ang, or Increasing the portion of NCME's total income 
generated through each of these revenue sources. 
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Fig. 20 Percent Endorsing Various Strategies for Increasing NCME's Membership 
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Results summarized in Figure 21 Indicate that very few respondents 
would recommend decreasing proportionate revenues generated froni a.iy 
current NCME source. About three-fourths recommended holding the line 
on membership dues and prices of subscriptions to both major Journals. 
About two-thirds gave the same recommendation for annual meeting charges 
and the costs of other revenue-generaUng activldes, such as special 
pubUcatlons. Between 16 and 18 percent of respondents recommended 
increases between S% and 10% In membership dues and costs ot Journal 
subscriptions, and a fourth reconmiended increases in this range for annual 
meeting reglstraUon and other revenue-generating activities. Increases 
exceeding 10% were recommended by very few respondents. 

In the expenditure section of the survey, respondents were shown a 
pie chart Indicating that 39 percent of NOME'S budget was allocated to 
publication of JEM, 28 percent was allocated to administration and 
governance of the organization, 20 percent was aUocated to publication of 
EMiiE. 10 percent was allocated to the annual meeting, and three percent 
was allocated to special projects. Respondents were asked to recommend 
either decreasing, maintaining, or increasing the portion of NCME's total 
budget allocated to each of these categories of ejcpenditure. 

As was true of recommendations on revenue generaUon the vast 
majority of survey respondents recommended no changes in NCME's 
expenditure aUocation. As shown in Figure 22. about three-fourtlis of 
respondents recommendeu no change in the portion of NCME's budget 
allocated to the annual meeting and publicaUon of EM.-IP : just over seventy 
percent made the same recommendation for publicaUon of JEM and 
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Fig. 21 Distribution of Recommended Budget Adjustments by NCME Income Category 
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Fig. 22 Distribution of Recommended Budget 



Adjustments by Expenditure Category 



(0 

c 

0) 

E 

0) 
3 

< 



c 
o 
a 

X 

UJ 



Increase > 10% 



Increase 5% to 10% 



Keep the Same 




□ Special Projects 

^ Annual Meeting 

B Publication of EM:IP 

M Publication of JEM 

■ Administration 

24.3 



Decrease 5% to 10% 



Decrease > 10% 





4 0 

Percent 



r— 

6 0 



— I 
8 0 



ERIC 



64 



The ruture of NOM E 



Jaeffer & Camp 



NOME'S adminlstraUon and governance, and two-thirds recommended 
holding the line on spending for special projects. Hardly any respondents 
recommended budget changes exceeding 10% for any category of 
expenditure. However, about a fourth recommended a 5% to 10% Increase 
m expenditures for special projects, and twelve to fourteen percent 
recommended similar increases for NCME's publicaUons and the annual 
meeting. Expenditures for administration and governance were the prime 
target for increased fiscal control: Just over 18 percent recommended a 5% 
to 10% reduction In expenditures 



In summary, a substantial minority of the membership (up ^o a fourth) 
would support Increases in registration charges for the annual meeting and 
increased costs associated with the products of NCME's special projects. 
Very few members recommended reductions in the costs of membership. 
Journal subscrlpUons, or annual meeting registration. 

On the expenditure side of the ledger, most memberb favor no 
changes in budget allocation, and for most categories of expenditure, those 
favoring modest increases or decreases are evenly balanced. The exceptions 
are special projects, where a fourth of the membership favors increased 
expenditures in the 5% to 10% range, and administration and governance, 
where almost one in five members favor reduced expenditures in the same 
range. 
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Although NOME'S membership application provides some information 
on the demogranhlc characteristics of the organization's membership, this 
information is limited to gender, race/ethnic background, and type of 
organization in which an applicant is employed. The survey sought 
additional information tlirough which could characterize its membership. 

As shown in Figure 23, more than three-fourths of NCME's members 
hold doctorates, and an additional 20 percent hold master's degrees. Ours 
is a highly educated membership. 

Educational measurement was the most frequently listed academic 
major in the highest-degree programs of survey respondents (almost 30 
p(;rcent), followed by educational psychology (16 percentji and education (15 
percent). Psychology was the only other academic major identified by more 
tlian 10 percent of survey respondents (see Figure 24). 

Figure 25 contains a summary of the current employment roles and 
status of survey respondents. The most frequency identified rcle was that of 
university faculty member (23 percent), followed ty measurement 
researcher (13 percent), test developer (10 percent), and public school 
administrator (10 percent). However, 21 percent of survey respondents 
selected "Other" when answering the question "Which of the following best 
describes your current employment role and status?". 

Almost a fourth of NCME's members are relative newcomers to the 
field of oducaUonal measurement (employed in the field no more than five 
years), and 29 perceiit are rolaQve "old timers" (with over 20 years of 
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Fig. 23 Distribution of Survey Respondents by Highest Degree 




Fig. 24 Distribution of Survey Respondents by Academic Major In Highest Degree 
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Fig. 25 Distribution of Survey Respon^lents by Current Employment Role or Status 
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employment In the field). The rest are spread almost evenly across five- 
year-employment categories (see Figure 26). 

As shown In Figure 27, more than a third of NCME's members Joined 

the organization within the past five years. The balance of the membership 

is uniformly distributed across five-year intervals, including more than 20 

years of membership. This distribution of length of membership might 

either be a cause for rejoicing (the Membership Committee has been doing 

an outstanding Job during the past five years) or a cause for alann (there is ; 

^ relatively high turnover among new recruits). A correct interpretation could j 

be informed by an analysis of the length of membership at time of non- j 

I 

renewal for those who have failed to maintain their NOME membership | 
during the past few years. • 



In summary, NCME's members are highly educated: tended to major 
In educational measurement or a closely related field in their terminal 
academic programs; more often are employed as unive rsity faculty members 
than in any other single role although their role positions are quite diverse; 
are sUghtly more likely to be "old timers" in tiie measurement field than 
"newcomers," although both groups are well represented; and are more 
likely to be In their first five years of NCME membership tiian in any other 
length-of-membership category. 
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Fig. 26 Distribution of Survey Respondents by Length of Employment in Field 
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Fig. 27 Distribution of Survey Respondents by Length of NCME Membership 
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Section I of this questionnaire concerns the underlying purposes of NCME. You are asked to consider 
the appropnateness of various organizational purposes, the importance of these purposes, and how successful NCME 
has been in achieving these purposes. Some of the stated purposes were derived from NCME's Bylaws 
and others have been suggested more recently by the NCME Committee on Past Presidents. It is important that 
you QQimm S2Sh slaled mms. indgpendently and that you respond to all three questions - - concerning 
appropriateness, importance, and success -for each stated purpose. 



DIRECTIONS 

An organizational purpose for NCME is stateo in each of Items 1 through 14. 

For each stated purpose: 

I. Circle INAPPROPRIA TE or APPROPRIA TE to indicate your judgment 
of the approcfiatgnass-of this purpose for NCME as an organization. 

II. Circle a number from 0 {NOT AT ALL IMPORTANT) to 5 {VERY IMPORTANT) 
on the left-hand scale to indicate your judgment of the Importance of this purpose 
for NCME as an organization. 

III. Circle a number from 0 {NOT AT ALL SUCCESSFUL ) to 5 {TOTALLY SUCCESSFUL ) 
on the right-hand scale to Indipate your judgment of how successful NCME has been 

in achieving this purpose. 

EXAI\/IPLE 

Consider the fictitious purpose: "NCME should become the principal teacher assessment and licensing agency in the United States" SuDoose 
you judged this purpose to be (a) Inappropriate for NCME, (b) not at all Important as an organizational purpose, and (c) judged NCME to have ex- 
perlenced very limited success in achieving this purpose. You would then answer the three questions posed for this purpose as follows: 



PURPOSE 

NCME should become the 
principal teacher assessment 
and licensing agency in the 
United States. 



APPROPRIATENESS 

Cle one: 




APPROPRIATE 

(TN* M an approprial* 

puipoae lor NCME.) 



IMPORTANCE 

Circle a number on the scalo below: 



.1. 



NOT AT ALL 
IMPORTANT 

pufpos0.) 



I 



VERY 
IMPORTANT 
(NCMf: definitely 
ihovid pursue 
thfs purpose.) 



SUCCESS 
Circle a number on the scale below; 



NOT 

SUCCESSFUL 
(NCM£ has na 
bemj 8UCC0S -fut 



I 



VERY 
SUCCEiJSFUL 
(NCM£ has 
very succe^fuf 
et tf}is.) 
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PLEASE ANSWER THE QUESTIONS CONCERNING APPROPRIATENESS IMPORTANCE 
AND SUCCESS FOR EACH OF THE PURPOSES STATED IN ITEMS 1 THROUGH 14 ^ 



PURPOSE 

1. NCME should promote 
scholarly activity aimed at 
developing the theory of 
educational measurement. 



APPROPRIATENESS 

Circle one: 



INAPPROPRIATE 

(TNskQQi an 
appropriate purpose 
tor NCME,} 



APPROPRIATE 

(TNs is ar\ appropriata ' 
pufposa for NCM£.) 



IMPORTANCE 
Circle a number on the scale below: 



1 



NOT AT AIL 
IMPORTANT 
(NCME should not 
purBua thia 
pvrpoM.) 



I 

VERY 
IMPORTANT 
(NCME (hfinlMy 
should pursue 
ihb purpose,} 



SUCCESS 
Circle a number on the scale below: 



I I 

0 1 



NOT 

SUCCESSFUL 
(NCME haaryot 
beef) socceasful 
at thia.) 



I 



VERY 
SUXESSPUL 
(NCME haaba^ 
veryauccaaaM 
at thia.) 



PURPOSE 

2, NCME should promote 
scholarly activity aimed at 
improving measurement 
procedures in education. 



APPROPRIATENESS 

Circle one: 



INAPPROPRIATE 

(ThialajiQi ar) 
ap^ roprlatapvrpoaa 

forfX^ME.) 



APPROPRIATE 

(TNakBomroprlata 

purpose for NCME.) 



IMPORTANCE 
Circle a number on the scale below: 
I 1 I I I I 

0 1 2 3 4 5 



SUCCESS 

Circle a number on the scale below: 



I I, 

1 



J I 



NOT AT ALL 

IMPORTANT 

(NCMEahouidfXJi 

purauathk 

pufpoaa.) 



VERY 
IMPORTANT 
(NCME dethffefy 
ihouki pursue 
thia purpoaa.) 



NOT 

SUCCESSFUL 
(NCME has f)ot 
been auoceeaful 
at this,) 



VERY 
SUCCESSFUL 
(NCME haa 
very auoceaafut 
Mtthh.) 



PURPOSE 
3. NCME should promote 
scholarly efforts aimed at 
impro\ing the instruments 
used in educational 
measurement. 



APPROPRIATENESS 
Circle one: 



INAPPROPRIATE 

appropriate purpose 
for NCME.) 



APPROPRIATE 

(ThIa M tu) apprcpriata 
putpoae for NCME.) 



IMPORTANCE 

Circle a number on the scale below: 



NOT AT ALL 
IMPORTANT 
(NCME should rHA 
punuethia 
purpoaa,) 



I 



VERY 
IMPORTANT 
(NCME dethDely 
ihould pursue 
thia purpoaa.) 



SUCCESS 
Circle a number on the scale below: 



I 1, 

0 1 

I 

NOT 

SUCCESSFUL 
(NCME has ryot 
baen siX)ceaaful 
at thia,) 



I 



.1 



VERY 
SUCCESSFUL 
(NCM^ haabaim 
very auccaaafuf 
»ttNa.) 
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PURPOSE 

4. NCME should promote 
scholarly efforts to apply 
what is known about 
educational measurement to 
the assessment of individuals. 



APPROPRIATENESS 

Circle one: 



INAPPROPRIATE 

appropriate purpose 
fOfNCMB.) 



APPROPRIATE 

(ThitHunspptoprkte 

purpose for NCMe.) 



PURPOSE 

5. NCME should promote 
scholarly efforts to apply what 
is known about educational 
measurement to program 
evaluation. 



APPROPRIATENESS 

Circle one: 



INAPPROPRIATE 

(Thklejost Mf) 
appropriate purpoeii 
for NCME.) 



APPROPRIATE 

(Thktanapproprfate 
potpcee for NCME.) 



PURPOSE 

6, NCME should disseminate 
knowledge rfjlated to the 
theory of ed national 
measurement 



APPROPRIATENESS 

Circle onr 

INAPPROPRIATE APPROPRIATE 

(Thk knoi Mf) (Thk is 4w eppropriefe 

app.vprive pvrpoee pvfpoee for NCMEA 

for NCME.) 



PURPOSE 

7. NCME should dissminate 
knowledge related to proce- 
dures used in edu-^ational 
measurement. 



APPROPRIATENESS 
Circle one: 

INAPPROPRIATE APPROPRIATE 

{TfrM i$DSi an (m^ M an ^i'>ipr1efe 

in n^r^afeptjfpose puf}>oee for NCME.) 

for NCME.) 
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IMPORTANCE 

Circle a number on the scale below: 



1 



I 

0 

I 

NOT AT ALL 
IMPORTANT 
(NCME ihovld not 



.1 I, 



I 

VEPY 
IMPORTANT 
(NCME dofhiiely 
shouki pursue 
tt)ls purpose,) 



SUCCESS 
Circle a number on the scale below: 



0 i 



NOT 

SUCCESSFUL 
(NCMEheeryof 
been Buoceesfvl 
at thh.) 



,1 



I 

VERY 
SUCCESSFUt 
(NCME hMbeen 
very eooceeefvl 
atm) 



IMPORTANCE 

Circle a number on the scale below: 



0 i' 
I 

NOT AT ALL 
WPOHTANT 
(NCME ahoufd not 
pursue thk 
pvrpoee.) 



VEflY 
IMPORTANT 
(NCME defhitefy 
ihoufdpurBue 
this porpoee.) 



SUCCESS 

Circle a number on the scale below: 



0 I 



NOT 

SUCCESSFUL 
(NCMEhMrxX 
beef] eiooeesfut 
at thk.) 



4 



.1 
5 

I 

VERY 
SUCCESSFUL 
(NCME hmbeen 
very iuoceeefvi 
at thk.) 



IMPORTANCE 

Circle number on the scale below: 



NOT AT ALL 
IMPORTANT 
(NCME ehould not 
pursue thk 
purpose.) 



VERY 
IMPORTANT 
(NCME defhHety 
ghoufd pursue 
thk purpose.) 



SUCCESS 

Circle a number on the scale below: 

0 1 2 3 4 ^5 



NOT 

SUCCESSFUL 
(NCME has not 
been successfui 
at thk.) 



I 

VERY 
SUCCESSFUL 
(NCME hae been 
very suocesifut 
atthfi.) 



IMPORTANCE 

Circle a number on the scale below: 



NOT AT ALL 

IMPORTANT 

(mMd$houkin<A 

puK^thk 

purpose.) 



I. 



^ 



VERY 
IMPORTANT 
(NCME defhlfefy 
ilxyjfd piirsue 
thk purpose.) 



SUCCESS 
Circle a number on the scale below: 



1 



NOT 

SUCCESSFUL 
{NC r*B has not 
been successful 
at thk) 



I, 
3 



.1 



I 

VERY 
81XX:ES3FUL 
(ttCME has been 
very suijcessfuf 
at thk.) 
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PURPOSE 
8. NCME should disseminate 
knowledge related to the 
improvement of instruments 
used in educational 
measurement. 



APPROPRIATENESS 

Circle one: 

INAPPROPRIATE APPROPRIATE 

(TNshQQiMn (Thh ^ on mpptopriaf 

approf>rfst0 purpose pufpo6^ for NCMB) 

iofNCME) 



PURPOSE 

9. NCME should disseminate 
knowledge related to educational 
assessment and evaluation 
of individuals. 



APPROPRIATENESS 

Circle one: 



INA[^PROPRIATE 

Bppfopf1at6pvrpos0 

forNCMB) 



\PPROPRIATE 
pvrposefOfNCKIB) 



PURPOSE 

10. NCME should 'isseminate 
knowledge related to educational 
assessment and the evaluation of 
programs. 



APPROPRIATENESS 

Circle one: 



INAPPROPRIATE APPROPRIATE 

(This knot »n (TNs if an appfOf^i$m 

approQfiat0pvfpoa0 pumoso for NCME) 
for NCME) 



PURPOSE 
11, NCME should promote 
standards for tcicher preparation 
in tht field of educational 
measurement. 



APPROPRIATENESS 
Circle one: 

INAPPROPRIATE APPROPRIATE 

(This kctCH M (Thk jj in ^(jpr*i/# 

apprvp.fiit6pvfp(M0 pvtpoM tot NCME) 

for NOME) 
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IMPORTANCE 

Circle a number on the scale below: 
I I I I I I 

0 1 2 3 4 5 
I 



NOT AT ALL 
IMPORTANT 
(NCME 8hovtd not 
ptfnu0thl0 

pVfpO60,) 



VERY 
IMPORTANT 
(NCME definitely 
9hould pursue 
tt)l0 putpooe.) 



SUCCESS 
Circle a number on the scale below: 



1 



I 



NOT 

SUCCESSFUL 
(NCME ha8 not 
betn suoc00sfuf 
0ttt)h,) 



4 5 

I 

VERY 
SUCCESSFUL 
(NCME fm b90n 
V0ry0uoc00$M 
sttN$,) 



IMPORTANCE 

Circle a number on the scale below: 
I 1 I I I I 



1 
I 

NOT AT ALL 
IMPORTANT 
(NCME $houfd not 

pVf9U0tt)k 

purpo00.) 



I 

VERY 
IMPORTANT 
(^E dofhft0ly 
$f}ou}d pvrBU0 

tt)k pVfpO60,) 



SUCCESS 
Circle a number on the scale below: 



1 



NOT 

SLfCCESSFUL 
(NCME tm not 
bo0n $ucce6afol 
atttih.) 



VERY 
SUCCESSFUL 
(NCME hMb00n 
yory ${jcc00$tul 
atthh,) 



IMPORTANCE 

Circle a number on the scale below: 
I l_l_l I I 

0 1 2 3 4 5 



NOT AT ALL 
IMPORTANT 
(NCMB 8f)ouldnot 

Pi*fBU0 tf)l6 
pUfpO00.) 



VERY 
IMPORTANT 
(NCME delinilely 
should pursue 
\f)ls purpose.) 



SUCCESS 

Circle a nu^-^^ber on the scale below: 



I \, 

0 1 



NOT 

SUCCESSFUL 
(NCME has not 
b00n $uoc00Mtul 
at thk,) 



I 



I I 

4 5 
I 

VERY 
SUCCESSFUL 
(NCME has b00n 
V0ty$ucc00sM 
atthti.) 



IMPORTANCE 
Circle a number on the scale below; 



I. 



1 



.1. 



I 

NOT AT ALL 
IMPORTANT 
(NCME should not 
punue this 
purpoea.) 



VKRY 
IMPORTANT 
(NCME definitely 
should pursue 
this putpo&e.) 



SUCCESS 

Circle a number on the scale bCiuw: 
I I I I I I 

0 1 2 3 4 5 



Ncr 

SUCCESSFUL 
(NCME has not 
been s\fcc06sful 
at this,) 



I 

VERY 
SIX;CESSFUL 
(NC'ME hast)00n 
vwy $uoc09$fuf 
at this.) 
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PURPOSE 

12. NOvIE should promote 
standards for the acaeditation 
and certification of professionals 
in educational measurement. 



APPROPRIATENESS 

Circle one: 

INAPPROPRIATE APPROPRIATE 

imisoaltn (TNs Is an §ppfopHat* 

approprtai* purpose ouipoM tor NCM£) 

lorNCME) ' . 



PURPOSE 

13. NCME should promote 
adherence to the Standards for 
Educational and Psychological 
TesHngby assuming appropriate 
public policy positions. 



APPROPRIATENESS 

Circle one: 



INAPPROPRIATE 

IThlikDa W 
tpproprlalapvrpoae 
lor NCME) 



APPROPRIATE 

IThl«lsin»ppftjpr1at» 

purpoM tor NCME) 



PURPOSE 

14. NOME should promote 
adherence to standards of 
professional cx)nduct among 
those in the field of 
educational testing and 
measurement 



APPROPRIATENESS 
Circle one: 



INAPPROPRIATE 

•pprvptiBtB purpose 
tor NCME) 



AP^^ROPRIATF 

pvfpo64 for NCME) 
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5 



IMPORTANCE 

Circle a number on the scale l/}Iow: 



1 



NOf ATALL 
IMPORTANT 
(NCME ihovid not 
puntMfthh 
putpo$0) 



5 



VERY 
IMPORTANT 
(NCME dot infteiy 
$houkf por8U0 
this pvqxxse.) 



SUCCESS 
Circle a number on the scale below: 



1 



NOT 

SUCCESSFUL 
(NCME hM not 
bew ${KC9Sstul 
at thh,) 



I. 



I 



I 

VERY 
SUCCESSFUL 
(NCME tmimn 

attNt,} 



IMPORTANCE 

Circle a number on the scale below: 



SUCCESS 

Circle a number on the scale below: 



1 



2 



1 



NOT AT ALL 
IMPORTANT 
(rfCMEihovldnot 

pOf9U0 thk 

pofpoeo) 



VERY 
IMPORTANT 
(NCME (hthMy 
§hpuldpuntU0 
thl« pU/pO90,} 



NOT 

SUCCESSFUL 
(NCMy t)A$ noi 
be^n succoMfut 
at this,) 



VERY 
SUCCESSFUL 
(NCME hastmn 

attN9,f 



IMPORTANCE 

Circle a number on the scale below: 



1 



NOT AT ALL 
IMPORTANT 
(NCME ahyofd not 
pofttMfthk 
pufpo«9,) 



VERY 
IMPORTANT 
(NCME d^f'n/f^ty 
ihovtd fyiffiu^ 
thkpurpoM,) 



SUCCESS 

Circle a number on the scale below: 



0 1 

I 

NOT 

SUCCESSFUL 
(NCMEha$f>ot 

atthkt,} 



I. 



I I 

4 S 



VERY 
SUCucaSFUl 
(NCME hmt»mi 
V0fy iuccmihtf 
stthk,} 
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15. Are there any additional purposes tl at you feel NCME should adopt? ...YeS I I ... No I 1. if vou msworf^ "Y.. " re 

concerning the appropriateness or importance of NCME's purposes, or NCME's success in achieving its purposes. ^ ^ 



Section \\ 



Section II of this questionnaire Is concerned with the activities of NCME. You are asked to consider 
whether NCME should continue with the activities in which it has been involved, and If so. how much emohasls 
should be given to them. 



DIRECTIONS 

An organizational activity of NCME is stated in each of items 16 through 38, 

For each stated activity: 

I. Circle AGREE or DISAGREE to indicate whether you think NCME siiuuid or 
should not continue the activity stated. 

II. Cirjle a number from 0 {NOT AT ALL IMPORTANT) to 5 {VERY IMPORTANT) 
on the scale to the right to indicate your judgment of the importance of this activity 
for NCME as an organization. 



PLEASE ANSWER THE "CONTINUATION" QUESTION AND THE QUESTION CONCERNING 
IMPORTANCE FOR EACH OF THE ACTIVITIES IN ITEMS 16 THROUGH 38. 



ACTIVITY 

16. NOME should hold annual meetings. 



17. NOME should provide presessions and workshops 
at its annual meetings. 



18. NCME should publish the Journal of Educational 
Measurement 



19. NCME should publish Educational Measurement: 
Issues and Practice . 



20. NCME should publish Ins tructional Tpp igg in 
Educational Measurement (ITEMS)> 



CONTINUATION 

Circte one: 



AGREE 

(NCME should 
continue this 
Activity.) 



AGREE 

(NOME BhouW 
oontlnut thli 

RctMty.) 



AGREE 

(NCME should 
cootinu« this 
activity.) 



AGREE 

(NCME should 
continue this 
activity.) 



AGREE 

(NCME should 
oonilnuf this 
«ctMty.) 



DISAGREE 

(NCME should not 
continut this 
ActMty.) 



DISAGREE 

(NCME should not 
oontlnut this 
actMty.) 



DISAGREE 

(NCME should not 
oontlnut this 
ftcth^ty.) 



DISAGREE 

(NCME should not 
continui this 

activity.) 



DISAGREE 

(NCME should not 
contlnut this 
•ctMty.) 



IMPORTANCE 

Circle a number on the scale below: 

"2 ^3 ^4 5 



1 



NOT AT ALL 
IMPORTANT 



NOT AT ALL 
MPORTANT 



NOT AT ALL 

IMPORTANT 



NOT AT ALL 
IMPORTANT 



NOT AT ALL 
MPORTANT 



VERY 
IMPORTANT 



VERY 
IMPORTANT 



VERY 
IMPORTANT 



VERY 
IMIORTANT 



''i 5 



VERY 
IMPORTANT 



o . 87 



7 



88 



ACTIVITY 

21 . NCME should continue its other publication 
activities, such as the Handbook of Teacher Evalua tion. 



22. NCME should increase the volume of its 
publication activities; e.g., by adding publications or by 
increasing the size of its existing publications. 



23. NCME should continue to publish the Resource Bank . 



24, NCME should monitor the adherence of the testing 
and measurement industry to the Code of Fair Testing 
Practices . 



25. NCME should sponsor measurement training 
programs for teachers. 



26. NCME should assist colleges and univer >ities in 
recruiting students to the field of educational 
measurement. 



27. NCME saould recruit minoritie.s to the field 
of educational measurement. 



28. NCME should increase its efforts to recruit 
minorities to NCME, 
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CONTINUATION 

Circle one; 



AGREE 

(NCMEihould 
conttnuf thli 

a«h/tty.) 



AGREE 

(NOME should 
continue tfili 

«c<Kity.) 



AGREE 

(NCMEihould 
continue tfilt 
activity.) 



AGREE 

(NCMEihould 
contlnua thts 
act^Hy.) 



AGREE 

(NCMEihould 
coot)nu« thti 
wttvtty,) 



AGREE 

(NCMEihould 
oontinut thti 
actlvtty.) 



AGREE 

(NCMEihould 
oontlni'^ this 
actMty.) 



AGRtiE 

(NCMEihould 
oontihua thti 
AdMty.) 



DISAGREE 

(NCMEihould not 
oontinua thli 
actMty.) 



DISAGREE 

(NOME ihould not 
contlnu« this 

actlvfty.) 



DISAGREE 

(NCME Ihould not 
oomlnut thli 
actMty.) 



DISAGREE 

(NCME Ihould not 
oontlnua thli 
activity,) 



DISAGREE 

(NCME Ihould not 
oontlnua thk 
actMty.) 



DISAGREE 

(NCME Ihould not 
contlnua \hk 
actMty.) 



DISAGREE 

(NCMEihould not 
oortlnua thii 
activity.) 



DISAGREE 

(NCME ihoold not 
contlnut thli 

activity.) 



IMPORTANCE 

Circle a number on the scale below; 

— I I I I I 

1 2 3 4 5 



NOT AT ALL 
IMPORTANT 



NOT AT ALL 
MPORTANT 



NOT Af ALL 
MPORTANT 



NOT AT ALL 
MPORTANT 



NOT AT ALL 
MPORTANT 



NOT AT ALL 
MPORTANT 



NOT AT ALL 
IMPORTANT 



.1 I 



J 

2 



VERY 
IMPORTANT 



VERY 
IMPORTANT 



VERY 
IMPORTANT 



.1 L 



V£ Y 
IMPORTANT 



VERY 
IMPORTANT 



VERY 
IMPORTANT 



VERY 
IMPORTANT 



NOT AT All 
MPORTANT 



VERY 
IMPORTANT 



8 
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ACTIVITY 



29. NCME should monitor legislation that is pertinent 
to educational testing and measurement. 



30. NCME should disseminate information to 
legislators and policy makers. 



31 . NCME should work with other research organizations 
interested in testing and measurement in education. 



32, NCME should work with legislatures on legislation 
pertinent to educational testing and measurement. 



33. NCME should work with professional non-research 
organizations; e.g., the National EducaHon Association, the 
American Federation of Teachers, the American Association 
of School Administrators, etc. 

34. NCME should work with other organizations to 
take advocacy positions on legislation or public 

policy issues that are pertinent to educattonal testing and 
measurement. 

35. NCME should work with other organizations to 
identify educatiotial measurement skills and information 
needed by professionals in education. 

36. NCME should work with other organizations to set 
standards for jn-ofessional conduct in educational 
measurement. 



8.1 




CONTINUATION 

Circle one: 



AGREE 

(NCME should 
continue ttiii 

activity.) 



DISAGREE 

(NCME thouM not 
oontlnu« tfid 
actMty.) 



IMPORTANCE 

Circle a number on the scale below: 



1 



NOT AT AIL 
IMPORTANT 



VERY 
IMIXDRTANT 



AGREE 

(NCME should 
continue tfili 
activity.) 



DISAGREE 

(NOME ihoukJ not 
oortlnuo ihk 
activity.) 



NOT AT ALL 
IMPORTANT 



VERY 
IMPORTANT 



DISAGREE 

(NOME ihoutd not 
oontlntNi thU 
actMty.) 

DISAGREE 

(NCME thouM not 
oontkHM thti 
actMty.) 



NOT AT ALL 
IMPORTANT 



.1 1. 



NOT AT ALL 
IMPORTANT 



VERY 
IMPORTANT 



VERY 
IMPORTANT 



DISAGREE 

(NCME ihoulc< iXA 
continu* *h)i 
activity.) 



NOT AT ALL 
IMPORTANT 



VERY 
IMPORTANT 



DISAGREE 

(NCME ^ho^M not 
oontloiHi thli 
ac!Mty.) 



NOT AT ALL 
IMPORTANT 



VERY 
IMPORTANT 



Disagree 

(NCME fthouM not 
oontlnua thli 
activity.) 



3 



NOT AT ALl. 
IMPORTANT 



Vl'H> 
IMPORTANT 



DISAGREE 

(NOME should not 
contlnua thit 
actMty.) 



NOT AT ALL 
IMPORTANT 



VERY 
IMPORTANT 



9 
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ACTIVITY 

37. NQ4E should work with other organizations to develop 
procedures for acaeditation and certification of professionals 
in the field of educational measurement. 



38. NGvlE should work with other organizations to 
develop curriculum standards for teacher preparation in 
the field of educational measurement. 



AGREE 

(NCMEfthoutd 
conllnud this 
activity.) 



AGREE 

(NOME ihould 
continue thli 
acilvtty.' 



CONTINUATION 

Circle one: 



DISAGREE 

(NOME Ihould not 
contlnud this 
actlvtty.) 



DISAGREE 

(NOME Ihould not 
continue thto 
activity.) 



IMPORTANCE 

Circle a number on the scale below: 



1 



NOT AT AIL 
IMPORTANT 



VERY 
IMPORTANT 



NOT AT ALL 
IMPORTANT 



VERY 
IMPORTANT 



39. What suggestions do you have for ways in whichN CME should work with other organizations? Please list your suggestions in the space provided. 
If you have no suggestions, check this box: | | None 



40. Are there any additional acHvities that you feel NCME should pursue?...Yes | | 
activities below and indicate now much emphasis you think they should be given. — 



... No I/you answered "Yes," plea;« list the 
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Section III 



R«^li?rhl'I l^," ^^^'^^ information on your personal Involvement In the activities of NCME 

Recall that all information you provide will be held in strict confidence, and that the results of this survpv will Hp InnrtoH 
on y or aggregates of NCME members. The information sought in this sectton Is e sen fal i)r p^^ 
activities, and for evaluating the effectiveness of NCME's past and current activ tU ^^^^ 



DIRECTIONS 



PLEASE ANSWER QUESTIONS 41 THROUGH 52 BY CIRCLING THE RESPONSE 
TO EACH QUESTION THAT IS MOST APPLICABLE TO YOU. 



41. How many NCME Annual Meetings have you attendad in the last 5 years? 

a) 0 b)l c)2 d)3 e)4 

42. At how many NCME Annual Meetings in the last 5 years have you presented 
paper or been a presenter in a symposium? 



f)5 



a)0 b)l c)2 d)3 e)4 f)5 

43. At how many NCME Annual Meetings in the last 5 years have you particpated as 

a session chair, a discussant or a reactor? 

a) 0 b)l c)2 d)3 e)4 f)5 

44. At how many NCME Annual Meetings in the last 5 years have you attended a 
training session sponsored by NCME? 

a) 0 b)l c)2 d)3 e)4 f)5 

45. How frequently do you read the Tournal of Educational Measurement (JEM)? 

a) never b) seldom c) occasionally d) regularly e) every issue 



46. How frequently have you used the Journal of Edur.tipnal Mea.nrpmon^ (jem) in your 
scholarly or professional activities? ' ^ 

a) never b) seldom c) occasionally d) regularly e) every issue 

47. How many papers that >ou authored or co-authored have been published in the Journal of 
Educationa l MeasuremF jnt (JEM) ? 

a) 0 b)lor2 e)3to5 . d)6to9 e)10ormore 

48. How frequently do you read E ducational Measurement: Iss ues and PrarhVp (EM:IP) ? 

a) never b) seldom c) occasionally d) regularly e) every issue 

49. How frequently have you used Educational Measurement: I ssues and Prartirp (EM-TP) in 
your scholarly or professional activities? 

a) never b) seldom c) occasionally d) regularly e) every issue 

50. How many papers that you authored or co-authored have been published in Educational 
Measurement: Issues and Practice (EM:IP) ? 

a) 0 b)lor2 c) 3 to 5 d) 6 to 9 e)10ormore 

51. How frequently have you used the Instructio nal Topics i n Edu cational M e asurement (ITEMS) 
mstructional modules published in Educational Measure me nt: Issues a nd Prartire (EM:IP) ? 

a) never b) seldom c) occasionally d) regularly e) every module published 

52. How frequently have you used the NCME Re source Rank of references to educational 
measurement literature? 

a) never b) seldom c) occasionally d) regularly 



Section IV 



Pn!I:I!?" nuestlonnaire seeks your judgement on the QUALITY of major activities sponsored bv NCME 

SSSlLo t ^' 1 '".s>r"c"ftnfll Topirn 'n Frtiirationril Monfiiir(!m(^nt (ITEMS) instSna 

1? , ° "measurement literature. Responses to these questions will auide the fo m^v evSS^ 



NCME activities. 



The NCME Annual Meeting 

consists of paper sessions and symposia, in addition to a breal<fast meeting and various traininq 
activities. The meeting is held during the middle three days of the annual meeting of the American 
Educational Research Association. 

DIRECTIONS 

Each scale is anchored by phrases that might be used to describe the NOME Annual Meeting Circle 
the position on each scale that best describes your judgment of a characteristic of the NCME Annual 
Meeting, or checl< the "No Opinion" box. 



53. The NCME Annual Meeting is: 
53.1 Very poorly organized 



Very well organized 



No Opinion 



53.2 Held in very inconvenient I 
locations ^ 



Held in very convenient 
locations 



No Opinion 



53.3 Very expensive to attend | 
(in terms of travel 1 
expenses) 

53.4 Very expensive to attend I 
(in terms of registration) ^ 



Very inexpensive to attend 
(in terms of travel expenses) 

Very inexpensive to attend 
(in terms of registration) 



No Opinion 



No Opinion 
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The NCME Annual Meeting (continued) 



o 

ERIC 



53.5 Too lengthy 

53.6 The content is not 
relevant to my current 
professional activities 

53.7 Held at a very 
inconvenient time 



.1 I, 



I I, 



.1 I l_l 



Too short 

The content is very 
relevant to my current 
professional activities 

Held at a very convenient 
time 



No Opinion [ | 
No Opinion 

No Opinion | [ 



NCME Professional Development Activities 



The following phrases anchor scales that might be used to describe the professional development 
activities (pre-sessions and worl<shops) held at the NCME annual meeting. Circle the position on each scale 
that best describes your judgment of a characteristic of these activities, or check the "No Opinion" box 



54. 
54.1 

54.2 



The professional development activities held at the NCME annual meeting are: 



54.3 



Very poorly organized 



Scheduled very 
inconveniently within 
the annual meeting 

Very expensive to 
attend 



.1 I. 



, I I Very well organized 



No Opinion | | 



I I I I, 



I I I I 



Scheduled very conveniently No Opinion I 1 

within the annual meeting ' ' 



Very inexpensive to attend No Opinion [ [ 



54.4 Too lengthy 



I I I I I 

1 r 3 4 5 



Too short 



No Opinion [ j 



54.5 



The content is lot 
relevant to my 
professional needs 
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2 3 4 5 
14 



I The content is very relevant No Opinion I I 
5 to my professional needs >— J 



100 



r 



Are thpany additioni^r changes to its annual meeting that should be made by NCME? 

...Yes LJ ••• ^^l—i marked "Yes," please describe the additions or changes you would 

suggest. Attach additional sheets of paper if necessary. ^ ^ 



NOME Publications 



include the quarterly publications OEM and EMUE, ITEMS , which is published in £M:i£ and the 
Mgsource Bank , which provides references to materials on various measurement topics. The foilowina 
section seeks information about how you evaluate these publications. The information souqht is 
essential to planning the NCME publications program. 



DIRECTIONS 

Following are characteristics of the Joumal of Frinn gtional Meafinmmon t (JEM). You 

are asked to describe how satisfied you are with these characteristics of this publication Circle a 

number from 0 {NOT AT ALL SATISFIED ) to 5 {VERY SATISFIED ), or check the "No Opinion" box. 

PLEASE CIRCLE YOUR RESPONSES TO EACH OF QUESTIONS 

56.1 THROUGH 56.6. 

56. JEM 

Circle a number on the scale below: 
56.1 Editorial policies I | , , , , jsjo Opinion | j 

0 1 2 3 4 5 I I 

1 • I 

NOT AT ALL VHRY 
SATIuFIED 8ATISIFE0 



o 15 
ERIC 
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TEM (coMtinued) 

56. .2 Timeliness of articles 



Circle a number on the scale below: 

0 1 2 3 ^4 ^5 

I 



No Opinion 



NOTATALL 
SATISFIED 



VERY 
SATISIFEO 



56.3 



Relevance of content 



I I I I. 



No Opinion 



56.4 Quality of writing 



NOTATAU. 
SATISFIED 

I ^1. 



VERY 
SATISIFEO 



I L 



No Opinion 



NOTATAU 
SATISFIED 



56.5 Quality of research 



VERY 
SATISIFEO 



I I I 1. 



No Opinion 



56.6 Scope of content 



NOTATAU 
SATISFIED 

I I. 

0 1 



NOTATAU 
SATISFIED 



VEHY 
SATISIFEO 



I 1. 



VERY 
SATISIFEO 



□ 



□ 



□ 



□ 



No Opinion | | 



DIRECTIONS 

Following are characteristics of Educa tional Measurement: Isnues and PrartioA (em: IP)). 

IZTmnr Vr^n^^ ^^^^^ characteristics of this publication. Circle a numbei 

from 0 {NOTATALL SATISFIED ) to 5 {VERY SATISFIED ), or check the "No Option" box. 



57. 
57.1 



ERIC 



PLEASE CIRCLE YOUR RESPONSES TO EACH OF QUESTIONS 

57.1 THROUGH 57.7 



EM: IP 
Editorial policies 



Circle a number on the scale below: 
^ ^ ^ ^ J ^ 

I I 

NOTATALL VERY 
SATISFIED SATISIFtO 

16 



No Opinion | | 
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EM: IP (continued) 



57.2 Timeliness of articles 



57.3 Relevance of content 
to my current 
professional interests 



57.4 Quality of writing 
presented 



57.5 Quality of research 
presented 



57.6 Scope of content 



57.7 Infor.nalion 

con':eming NCME 
a.' fions and activities 



Circle a number on the scale below: 
I 1 1 I 1 I 

0 1 2 3 4 5 

1 I 

NOTATALL vERY 

SATISFIED SATISIFED 

I — I — I I I I 

0 1 2 3 4 5 

1 I 

NOTATAa VERY 

SATISFIED SATISIFED 

I I I I I I 

0 1 2 3 4 5 

1 I 

NOTATAa VERY 

SATISFIED SATISIFED 

I I I ! l__l 

0 1 2 3 4 5 

1 I 

NOT AT ALL VERY 

SATISFIED SATISIFED 

0 1 2 3 4 5 

1 I 

NOTATAU VERY 

SATISFIED SATISIFED 

0 1 2 3 4 5 

1 I 

NOTATAa VERY 

SATISFIED SATISIFED 



No Opinion [ | 



No Opinion | | 



No Opinion 



□ 



No Opinion | j 



No Opinion | | 



No Opinion [ [ 



o 

ERIC 



17 
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DIRECTIONS 

Cri'llLtT"'^^^ °^ ^he ,l . Pgtructional Tooics in Fdi ■satelMga^umm^m (ITEMS) modules. 
You are asked to describe how satisfied you are with these characteristics of these modules Circle a number 
from 0 {NOT AT ALL SATISFIED) to 5 {VERY SATISFIED), or check the "No OpfnL' box." 

PLEASE CIRCLE YOUR RESPONSES TO EACH OF QUESTIONS 

58.1 THROUGH 58.4 



58, ITEMS 



68.1 Timeliness of topics 



Circle a number on the scale below: 



I I I L 



I I 



No Opinion | | 



68.2 Relevance of topics to 
my current professional 
interests 



NOTATAa 
SATISFIED 



l_. 

0 1 
I 

NOTATAU 
SATISFIED 



I I. 



VERY 
SATISIFEO 



I I 



VERY 
SATISIFEO 



No Opinion | | 



58.3 Appropriateness of 
level of discourse 



I I I I I. 



No Opinion 



68.4 Dissemination 
through EM; IP 



NOTATAa 
SATISFIED 



I I. 



VERY 
SATISIFEO 



I I 



No Opinion [ j 



NOT AT ALL 
SATISFIED 



VERY 
SATISIFEO 



ERIC 
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DIRECTIONS 



Following are characteristics of the NOME BfiSoyrce^. You are asked to describe how 
n J^".?'® ""^^ characteristics of this publication. Circle a number from 
0 {NOT AT ALL SATISFIED )\o 5 {VERY SATISFIED), or check the "No Opinion " box. 

PLEASE CIRCLE YOUR RESPONSES TO EACH OF QUESTIONS 

59.1 THROUGH 59.4 



59. The Resource Bank : 

59.1 Effectiveness of 
advertisements 
announcing the 
Resourc e Bank 

59.2 Timeliness of resources 
in the Resource Bank 



Circle a number on tho scale below: 

0 1 2 3 4 5 



NOT AT ALL 
SATISFEO 



VHRY 
SATISIPEO 



No Opinion 



No Opinion 



NOT AT ALL 
SATISFIED 



VKRY 
SATISIFEO 



59.3 Relevance of topics to 
my current professional 
interests 



59.4 Quality of selections 
in the Resource Bank 



NOT AT ALL 
SATISFIED 



No Opinion 



VEMY 
8ATISIFE0 



No Opinion 



NOT AT ALL 
SATISFIED 



VERY 
SATISIFED 



ERIC 
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Are there any additionsor changes to itspubli cations (JEM. EM: IP. ITEMS. Resource Bank) that NCME 



, , , ■> I ^ — x^^^L/ii^nuwiio vjjsivi, cLwi. 11 . II CMS. Kesource bank ) tnat 

should make? ...Yes [_] ... No Fj . If you marked "Yes/ please describe the additions or 



changes you would suggest. Attach adHItional sheets of paper if necessary 



61 . Should NCME increase the volume or scope of its publications activities? ...Yes | | ... No I I 
If you marked "Yes", please describe your suggestions. " ' ^—^ "' L 1- 



ERIC 
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Section V 



Section V of this questionnaire seeks Information concerning your Interest In participating In the governance of ncme 
Please circle the response to each question which best describes you • level of interest. governance of NCME. 



PLEASE CIRCLE YOUR RESPONSE TO EACH OF QUESTIONS 

62 THROUGH 64 

1^21?f of Directors consists of at least nine members, including the president, vice-president, 
immediate past president, and at least six other persons elected for a three-year term by mailed ballots of th 
active and emeritus members. ^ cuuanu.i,oim 

How interested are you in participating as a Board member of NCME? 

a) very interested b) fairly interested c) not at all interested 

63, The officers of NCME (Pres., Vice-Pres.) are elecied to a three-year term by mailed ballots of the active and 
emeritus members. 

How interested are you in serving as an officer of NCME? 

a) very interested b) fairly interested c) not at all interested 

64, Traditionally, members of committees are appointed by the President of NCME upon recommendation 
of the Chair. 

How interested are you in participating as a member of an NCME committee? 
a) very interested b) fairly interested c) not at all interested 
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Section VI 



65. 



66. 



PLEASE CIRCLE YOUR RESPONSE TO EACH OF QUESTIONS 

65 THROUGH 70C.12 

NCME Board members are elected for a Ihree-year term by mailed ballot. 
How satisfied are you with this procedure? 

a) very satisfied b) fairly satisfied c) not at all satisfied d) uncertain 
NCME officers are elected for a three-year term by written ballot of the active and emeritus members. 
How satisfied are you with this procedure? 

a) very satisfied b) fairly satisfied c) not at all satisfied d) uncertain 

67. Traditionally, Ad Hoc committees are chaired by an NCME member who is appointed by the Presi- 
dent of NCME, other committee members are appointed upon recommendation of the Chair. 

How satisfied are you with this procedure? 

a) very satisfied b) fairly satisfied c) not at all satisfied d) uncertain 

Traditionally, NCME's standing committees arc aired by a member of the Board who is appointed 
by the President of NCME. Other con\mittee members are appointed by the President upon the 
recommendation of the Chair of the committee. 

How satisfied are you with this procedure? 

a) very satisfied b) fairly satisfied c) not at all satisfied d) unrertain 
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68. 



69. NCME currently has a cooperative management agreement with the American Educational 
Research Association (AERA). 

How satisfied are you with this agreement? 

a) very satisfied b) fairly satisfied c) not at all satisfied d) uncertain 

If you are less than "very satisfied" with any aspect of NCME's organizational structure (Questions 65 - 69), use the following 
space to suggest modifications to NCME's structure: 



DIRECTIONS 

Listed below are some of the committees currently serving NCME. Please indicate, by circling the appropriate answer beside 
each named committee, how you would rate the functioning of each of these committees. 

PLEASE CIRCLE YOUR RESPONSE TO EACH OF QUESTIONS 

70A.1 THROUGH 70C.8 

70A. Ad Hoc Committees : 

70A.1 NCME-NATD a) excellent b) good c) fair d) poor e) don't know 
Relationship 

70A.2 Legislative and a) excellent b) good c) fair d) poor e) don't know 
Judicial Monitoring 

70A.3 RFP Guidelines a) excellent b) good c) fair d) poor e) don't know 
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70/VA Certification of a) excellent b) good 

Measurement Professionals 



70A.5 Instructional 
Materials 



c) fair d) poor e) don't know 



a) excellent b) good c) fair d) poor e) don't know 



70A.6 Recruitment of a) excellent b) good 

Educational Measurement 
Specialists 



c) fair d) poor e) don't know 



70A.7 Committee on 

Participation of Minorities 
in Education 




Vi\ ^^^^ 

D) good 


c) fair 


d) poor 


e) don't know 


70A.8 Committee on Past 
Presidents 


a) excellent 




c) fair 


ci^ poor 


e; don t know 


70B. Toin t Commi ttees 












70B.1 Standards for Program 
Evaluation 


a) excellent 


b) good 


c) fair 


d) poor 


e) don't know 


/WD.A v^ommitiee on 1 estmg 
Practices 


a) excellent 


b) good 


c) fair 


d) poor 


e) don't know 


70C. Standing Committees 












70C.1 Nominations Committee 


a) excellent 


b) good 


c) fair 


d) poor 


e) don't know 


70C2 Awards Committee 


a) excellent 


b) good 


c) fair 


d) poor 


e) don't know 


70C.3 Membership Committee 


a) excellent 


b) good 


c) fair 


d) poor 


e) don't know 


70C.4 Budget & Finance 
Committee 


a) excellent 


b) good 


c) fair 


d) poor 


e) don't know 


o 
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70C5 Publications Committee a) excellent b) good c) fair d) poor e) don't know 

a) excellent b) good c) fair d) poor e) don't know 



a) excellent b) good c) fair d) poor e) don't know 



70C.6 Career Award for Contri- 
butions to Educational 
Measurement 

70C.7 Training and Professional 
Development Committee 

70C8 Educational Testing a) excellem b) good c) fair d) poor e) don't know 

71, Do you think that any of NCME's Committees should be eliminated? ...Yes □ ... No I 1 Uncertalnl 

If you answered "Yes/ please list the committees that you think should be diluted and brieflTindicate your ratfcs 



If you rated any committee FAIR or POOR on the scales used in Question 70, please provide a brief 
statement concerning the committee(s)' shortcomings. 



o 113 

ERIC 



25 



114 



Section VII 



ITJZV^ °* ^''k concerned with NCME's membership. NOME has engaged in several activities designed to 

increase Its membership. You are asked to evaluate these efforts. 



DIRECTIONS 

Circle AGREE or DISAGREE to indicate your judgement regarding NCME's membership practices. 



73. NCME should try to expand its membership. 

74. NCME should seek to attract members of racial minorities. 

75. NCME should seek to attract more female members. 



Circle One 
AGREE DISAGREE 

AGREE DISAGREE 



AGREE 



DISAGREE 



76. NCME should seek to attract members from related organizations. ' AGREE DISAGREE 



77. NCME should continue sending contact letters to members of related AGREE 
organizations. 

78. NCME should continue to provide a booth at the AERA /NCME AGREE 
annual meeting. 

79. Shoul d NCM E take additional measures to attract new members? 



DISAGREE 



DISAGREE 



...Yes 

newm"^ 



ers. 



- No I I . If you marked "Yes," please list the strategies NCME should use to attract 
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Section VIII 



Section VIII of this questionnaire Is concerned with the finances of NOME. The following pie charts 
indicate the major sources of income and the major sources of expenditure for NOME. The proportions given 
below were calcu ated from the 1 989 budget. You are asked to express your satisfaction wSh the pro^rtton 
of mcorne generated and expenses incurred in conducting various activities of NCME, as shown on the 
pi6 cnsrts* 



80.3 



DIRECTIONS 

Listed below are various sources of Income. You are asked to evaluate the proportion of Income that Is 
genera ed by vanous sources shown in the pie chart to the right. For each source of Income circle one and only 
one option to mdicate how. if at all. you would change the proportion of NCf^E's Income generated by each of 
these sources (Keep in mind that increases or decreases in prices would result from changes) 



80.1 Membership Dues 
($35/year, active 
$22/year, student) 



80.2 TEM 



($25, individual 
one-year subscription 
$30, institutional) 



EM:IP 

($15, individual 
one-year subscription 
$20, institutional) 



a) decrease by more than 10% 

b) decrease by 5 to 10% 

c) keep the same 
d}mcrease by 5 to 10% 

e) increase by more than 10% 

a) decrease by more than 10% 

b) decrease by 5 to 10% 

c) keep the same 

d) increase by 5 to 10% 

e) increase by more than 10% 

a) decrease by more than 10% 

b) decrease by 5 to 10% 

c) keep the same 

d) increase by 5 to 10% 

e) increase by more than 10% 



(Dues) zefi 




(Other) 19X 



(Annual Meeting) \A% 



(EM: IP) 



(JEM) 23X 



NCME INCOME 
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80.4 Annual Meeting 
($25 - members 
$35 - nonmembers 
$10 -students) 



a) decrease by more than 10% 

b) decrease by 5 to 10% 

c) keep the same 

d) increase by 5 to 10% 

e) increase by more than 10% 



80.5 Other Sources 

(Spocia) Publications, 
etc.) 



a) decrease by more than 10% 

b) decrease by 5 to 10% 

c) keep the same 

d) increase by 5 to 10% 

e) increase by more than 10% 



61, Do yo u thin k thai NC ME sho uld attempt to secure funds from sources other than those listed above? 
•"Yes I 1 ... No If you answered "Yes/' please list potential sources for these funds. 



DIRECTIONS 

Listed below are the major gxpe.n$es NOME incurs. You are gsked to evaluate the proportion of NCME's 
budget allocated to the activities listed in the pie chart. For each of the major expenses, circle one and only 
one option. ^ 



82.1 



82.2 



82.3 



Administration 
(Central Office management. 
Board Meetings, etc.) 



Publication of TEM 
(Printing, mailing, 
editorial stafO 



Publication of EM:IP 
(Printing, mailing, 
editorial stafO 



82.4 Annual Meeting 

(Space rental, breakfast, etc.) 



82.5 Special Projects 

(Special publications, joint 
committees, etc.) 



a) decrease by more than 10% 

b) decrease by 5 to 10% 

c) keep the same 

d) increase by 5 to 10% 

e) increase by more than 10% 

a) decrease by more than 10% 

b) decrease by 5 to 10% 

c) keep the same 

d) increase by 5 to 10% 

e) increase by more than 10% 

a) decrease by more than 10% 

b) decrease by 5 to 10% 

c) keep the same 

d) increase by 5 to 10% 

e) increase by more than 10% 

a) decrease by more than 10% 

b) decrease by 5 to 10% 

c) keep the same 

d) increase by 5 to 10% 

e) increase by more than 10% 

a) decrease by more than 10% 

b) decrease by 5 to 10% 

c) keep the same 

d) increase by 5 to 10% 

e) increase by more than 10% 



(Annual Meeting)! OX 



(JEM) 39?? 




(EM:IP) 20% 



Special Projects) 3f 



(Admin & Gov.) 28?? 



NCME EXPENSES 
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83. Do you think NCME s hould make additions or changes in the way its budget is allocated? 



— ' — -^.T^- vy«iv* iiiaisc awuiiiwiio ur i.iiaiige& iii me way its Duaget is allocated? 

... No . If you answered "Yes/' please list additions or changes vou feel 



NCME should make in the way budgetary resources are allocated. 



Section IX of this questionnaire seeks some basic demographic Information from the members of NCME who 
complete this survey. This information is needed to help determine the representativeness of this survey and to formulate 
meaningful conclusions from th9 data that are collected. Remember that your responses will be held in strict confidence. 

PLEASE CIRCLE YOUR RESPONSE TO EACH OF QUESTIONS 

84 THROUGH 91 



84. What is your gender? 

a) Male 

b) Female 



85. What is your ethnic background? 

a) Black or Afro- American 

b) Oriental or Asian 

c) American Indian /Native American 

d) Hispanic 

e) Caucasian (non-Hispanic) 

f) Other (specify) 



123 



T 1 ■ b J 



30 



Demographics (continued) 



86. What is the highest degree you have received? 

a) Bachelors 

b) Masters 

c) Specialist 

d) Doctorate 



87. What was the specialty or major of your highest degree? 

a) Educational measurement 

b) Educational psychology 

c) Other areas in Education 

d) Counseling 

e) Psychology 

f) Sociology 

g) Statistics 

h) Other (specify) . • 



88. In what type of organization are you currentiy employed? 

a) College or University 

b) School system 

c) Staie agency 

d) Federal agency 

e) Industry 

f) Testing organization 

g) R & D organization 

h) Self-employed 

i) Other (specify) 
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Which of the following best describes your current employment role and status? 

a) University faculty 

b) University researcher 

c) University administrator 

d) Public School administrator 

e) Test developer 

f) Test administrator 

g) Measurement research 

h) Retired 

i) Unemployed 

j) Other (specify) 

How long have you been employed in the field of educational measurement? 

a) 0-5 years 

b) 6-10 years 

c) 11-15 years 

d) 16-20 years 

e) over 20 years 

How long have you been a member of NCME? 

a) 0-5 years 

b) 6-10 years 

c) 11-15 years 

d) 16-20 years 

e) over 20 years 

THANK YOU FOR YOUR COOPERATION 

Please return this completed questionnaire, in the envelope provided, to: 
Dr. Richard M. Jaeger 
NCME 

1230 17th Street, N.W. 
Washington, DC 20036 
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1230 Seventeenth Street, N.W., Washington, D.C. 20036 (202) 223-9318 



Dear Dr. : 

We are writing to seek your help in making NCME a more effective organization. 
We ask that you take 35 to 40 minutes (determined in a carefully-conducted pilot study) to 
complete the enclosed survey questionnaire and return your response to NCME 
Headquarters in the enclosed stamped, pre-addressed envelope. 

We are sending this questionnaire to a representative sample of NCME members to 
obtain tiieir judgments on the goals and activities of NCME - what has been done in the 
past and what should be done in the future; the services NCME provides its members; the 
structure and administration of NCME; and tiie ways funds are obtained and expended by 
the organization. Data obtained through this survey will be carefully analyzed and 
reported to the NCME Board and to the membership. The information we seek will be 
invaluable in planning NCME's purposes, activities, services, and operations over tiie next 
decade so as to best meet the needs of the measurement community and, through NCME, 
the measurement needs of the larger public we serve. 

We have numbered each questionnaire so as to make fiscally responsible use of 
NCME funds in sending follow-up letters to non-respondents. However, your responses 
will be held in strict confidence and will only be analyzed in aggregate. A rapid response 
on your part will help to minimize the cost of this survey. 

So please, take a few minutes to help your Board make NCME a better organization. 
And help us make NCME a more effective advocate for sound educational measurement. 
We look forward to hearing from you. 



Sincerely, 



Ronald K. Hambleton 
President, NCME 



Richard M. Jaeger, Chair 
Committee of Past Presidents 
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1230 Seventeenth Street N.W.. Washington. D.C. 20036 (202) 223-9318 



ERIC 



This Is a friendly reminderi Your completed NCME membership survey 
has not yet been received at NCME headquarters in Washington. As a 
f^'t f i" educational measurement, you know that a high response rate is 
essenhal if vahd conclusions are to be drawn from sample surveys. The NCME 
Board has invested substantially in learning the views of the membership on a 
number of issues that are vital to the fuhire of our organizaHon. Please do your 
part by completing and rehiming your quesUonnaire TODAY. Your prompt 
response wiU also reduce survey costs by eliminating the need to send you a 
second queshonnaire! ^ 

On behalf of the NCME Board, I thank you very much for your 
cooperation and response. ' 

Sincerely, 



Richard M. Jaeger, Chair 
Committee of Pas . Presidents 
(919) 334-5100 
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1230 Seventeenth Street, N.W., Washington, D.C. 20036 (202) 223-9318 



Dear Dr. : 

About a month ago, we wrote to seek your help in making NCME a more effective organii^tion. We 
asked that you take 35 to 40 minutes to complete an enclosed survey questionmire and that you return your 
response to NCME Headquarters. We are writing you once again to renew our request. On the chance that the 
original questionnaire was lost in the mail or was inadvertently mislaid, we are enclosing another one, together 
v/ith a stamped, pre-addressed envelope. 

We have sent this questionnain- to a representative sample of NCME members to obtain their judgments 
on the goals and activities of NCME - what has been done in the past and what should be done in the future; 
the services NCME provides its members; the structure and administration of NCME; and the ways funds are 
obtained and expended by the organization. Data obtained through this survey will be carefully analyzed and 
reported to the NCME Board and to the membership at the 1990 Annual Meeting. The information we seek will 
be invaluable in planning NCME's purposes, activities, services, and operations over the next decade so as to 
best meet the needs of the measurement community and, through NCME, the measurement needs oF the larger 
public we serve. 

We have numbered each questionnaire so as to make fiscally responsible use of NCME funds in sending 
follow-up letters to non-respondents. However, your responses will be held in strict confidence and will orJy be 
analyzed in aggregate. 

So please, take a few minutes to help your Board make NCME a better organization. And help us make 
NCME a nvore effective advocate for sound educational measurement. It is not too late to add your voice to those 
of several hundred NCME members who have already responded. We need your response and look forward to 
hearing from you. 

Sincerely, 



Ronald K. Hambleton Richard M. Jaeger, Chair 

President, NCME Committee of Fast Presidents 
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